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slntroMessage Received 
from a directly connected 
node 






Record the 
node count ni 
conne 


destination 
jmber for this 
action 



Send a Message to this 
directly connected node 
asking it to pick a new 
random tie breaker value. 
Set the Destination node 
count number to 0. 



No 

I 

Set a connection cost for 
the connection based on 

which node has the 
highest tie-breaker value 



I 



Done 







Is the tie breaker valu£ 
the same as any other 
directly connected node, 
including this node? 
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A New Connection is 
Created 



Send the slntroMessage 

with the random tie- 
breaker value created by 
this node 



Done 
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The ultimate destination node is connected to several 
nodes in the network and prepares to send an initial 
destination node update to its directly connected neighbor 

nodes. 
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As destination node knowledge spreads, each 

node that gets told of the destination node 
selects the node that told it as the 'target node' 
for messages routed to that destination node. 
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Knowledge of the destination node continues to 

spread, with each node that is told about the 
destination node choosing the node that told it. If 
another node provided it with a better hop cost later, 
the node would choose the directly connected node 
with the better hop cost. 
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In this step all nodes in the network are aware of the 
destination node and have a 'target node' that they 
can send messages that are destined for the 
destination node. 
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Indicates which directly connected node has been 
chosen as the next step to the core 

— A connection between two nodes 




A core is formed 
when two nodes 
choose each other as 
the next best step to 
the core 
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End User Application 




End User Application 




End User Application 




TCP/IP Like Socket Layer 




Message 
Routing using the 
new approach 




Routing Decisions, HSPP Management, Loop Detection, Etc 
using this new approach 



Network Devices Abstraction Layer 


Network Device"^^* 


Network Device""^^ 


Network DeviceT^^* 
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the service time ON Queue 3 
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Step 1 - Node A creates queue A1 and asks node B For a queue 
to send messages to. 



Node A 



Queue A1 y 



Node B 



Queue B ^ ) 



Step 2 - Node B creates queue B1 and tells node A about it using 

queue A1. 



Node A 



^ Queue A1 



Node B 



Queue B ^ 
Queue B1 ^) 



Step 3 - Node A sends a messages to queue B1 and node B 
sends ACK's to node A1 . 



Node A 



( ^QueueAl 



Node B 



Queue B ^ 
Queue B1 ^ 



Step 4 - Node A sends a messages to queue B confirming a 
connection to queue B1 



Node A 



^ Queue A1 



Node B 



Queue B ^ 
^ Queue B1 ^ 
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Step 3 - Knowledge continues to 
spread 
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Step 2 - Next iteration, two directly 
connected nodes now know of the 
queue. The arrows represent chosen 
destinations. 
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Step 4 - The whole network now has 
knowledge of the queue and there are 
no loops. 



Fig 32 



WO 2005/079001 



33/54 



PCT/CA2005/000194 



3 




2 




1 




— ► 




f 


i 






i 


i 


2 




3 




2 


\ 


j 








i 




1 


~+ — 


2 




3 



o 



Fig 33 



WO 2005/079001 



34/54 



PCT/CA2005/000194 



3 




2 




1 




— ► 




t 




i 




i 




2 




3 




2 


y 


f 








J 




1 


^ — 


2 




3 



o 



Fig 34 



WO 2005/079001 



35/54 



PCT/CA2005/000194 



Fig 35 



WO 2005/079001 PCT/CA2005/000194 



36/54 



□ t 



Fig 36 



WO 2005/079001 PCT/CA2005/000194 

37/54 



□t 




2 


► 


J 


1 

L 






3 






> 
i 


□t 




□t 






i 



Fig 37 



WO 2005/079001 



38/54 



PCT/CA2005/000194 



2 




1 


— ► 




i 




i 


L 


3 




2 


i 








i 


4 




3 



i 

0 



Fig 38 



WO 2005/079001 



39/54 



PCT/CA2005/000194 



3 


— ► 


2 


— ► 


1 










i 






t 




4 


— ► 




3 




2 




i 


i 




k 


i 




t 




5 




4 




3 





i 

0 



Fig 39 



WO 2005/079001 



PCT/CA2005/000194 



40/54 



Incoming Latency Update 



Incoming Update for a queue 
with Latency, 'At Capacity' 
Flag, 'Update Latency' and 
'fDI stance From Flow 




Yes- 



Ignore Queue 



Record the Latency, "At 
Capacity' Flag, 'Update 
Latency' and 
'fDlstanceFromFlow 



Tell Chosen 
Destination that 
this node is 
sending to it 



Record the Latency, 'At 
Capacity' Flag, 'Update 
Latency' and 
'fDlstanceFromFlow 





Set Latency to infinity, tell all 
directly connected nodes, 
freeze the sending of 
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Latency 
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Processed 



Yes- 



Remove this node 
as a Chosen 
Destination 



Yes 



Probe all possible choices 
with a GUID 



Wait predefined 
amount of time 
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Wait predefined 
amount of time, or until a non- 
infinity directly connected 
node is found. 
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Yes 



Pick Lowest latency, non-looping, 
non-infinity directly connected node 
as chosen destination. Preference a 
node not 'At Capacity' 



Remove all Messages 
from the queue, and 
remove knowledge of 
the queue. Done. 
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Latency At Infinity 



Queue Latency for Node has 
just gone to Infinity 




r 




Wait for a predefined 
amount of time 






f 




Pick the lowest latency, 
non-infinity directly 
connected node as a 
'Chosen Destination'. 
Preference to a node not 
'At Capacity' 
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If another predefined 

amount of time 
passes, remove all 
knowledge of the 
queue and delete 

msgs from this node 
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data path 
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Node wants to improve its 
routing while in the data 
flow, but is not currently 'At 
capacity' 
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possible. 
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The latencies of these nodes are spiraling 

upwards because of the loop. 
fUpdateLatency will also be spiraling up. 




3.1 



This node will switch to the node with 
latency 3.1 and eliminate the loop 
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A network of nodes connected by links. An arrow indicates a nodes choice 
for its next best step to the core. A line with two arrows indicates two 
nodes have chosen each other as their next best step to the core. 




This is the identical network that has been rearranged to better show the 
hierarchy that is formed by having each node pick its next best step to the 
core. The two nodes at the top of the hierarchy form the core. 
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